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INTRODUCTION 

Data representing the time history of physical and biological phenomena can be gener- 
ally classified as either deterministic or random, A purely deterministic function can 
be completely described in terms of an explicit mathematical expression which indi- 
cates its value at any instant of time. If the data cannot be so described, it is re- 
garded as random. Since each time record is unique, random phenomena can only be 
described in terms of their statistical properties. 

Correlation is one of the statistical methods most commonly applied to the analysis 
of random data. This analytical technique provides a means for extracting information 
and describing random data in the time domain, as opposed to either the frequency or 
amplitude domain. 

Normally, correlation is used to detect hidden periodicities within a signal or to pro- 
vide a quantitative measure of the interdependency between two signals. The problems 
most often solved are those which require isolation of a known or unknown periodicity 
from random activity, or distinguishing between two sources of random activity. Auto- 
correlation measures the similarity of a signal to a time-delayed version of itself, 
while cross correlation measures the degree of similarity of one source or input to a 
time-delayed second source. 

No synchronizing events need be available for the application of correlation techniques. 
The principal requirements are that the functions be stationary (i. e., their statistics 
do not change over the period of integration) and that the duration of each signal be 
sufficiently long in comparison to the period of its lowest frequency component. 

Typical applications for correlation include: 

(1) Determination of the transmission paths and propogation velocities of 
acoustic waves, seismic waves and mechanical vibrations. 

(2) Measurement of the impulse-response characteristics of industrial 
processes and servo control systems in the presence of noise. 

(3) Indication of epilepsy through comparison of electroencephalograms 
from the two halves of the brain. 

(4) Analysis of the tremor frequencies of patients afflicted with Parkinson's 
disease. 
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THEORY 


Stated mathematically. 


the autocorrelation function is defined as 


^ff (t) = 


lim 1 


00 2T 


f(t) f(t + T)dt, 


-T 



where T is the independent time-delay variable, 2T is the period of integration, and 
f(t) is the time function being studied. 


Since this is an even function [i. e., (t) = 0ff (“T)], the sign of r may be changed 

from positive to negative. Equation (1) can then be rewritten as 


0ff(T) = 


lim 
T -» oo 


2T 


T 



f(t) f(t-T)dt. 




This change in sign is necessitated by practical considerations, namely the fact 
that it is easier to delay a signal than to advance (or predict) it in time. 


Cross correlation is defined as 

0 (r)= — J f(t) g(t + T) dt, 

'^fg ' T - ~ 2T 

where f(t) and g(t) are the two different time functions being studied. 


Since 


^fg ( t ) 


0gf (r) 


0gf (-T)t this equation may be written as 

T 

f(t) g(t-T) dt. 

-T 


lim _]L 

T CO 2T 




A close approximation of the theoretical value of the auto- or crosscorrelation function 
can be achieved by digital computing techniques. Since any practical experiment 
must be conducted within a finite period, the closeness of this approximation is de- 
pendent upon the length of record T. In practice, for stationary functions, this record 
length should be at least one order of magnitude greater than the period of the lowest 
frequency component of interest. 

In order to apply digital computing methods, the maximum time delay T is 

divided into N intervals of At each, and the integral approximated through the 
summation of discrete partial products for each value of nAr. 
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Rewritten in discrete form, equation (2) can be approximated as 


1 


k 


0ff (nAr) , 2 1 S f(td f(t^-n 


n = 0, 1, 2, 3 N, 


where ^ ^ is the number of sample intervals. 


Similarly, equation (4) can be approximated by 

k 


^gf “ JTT . 


S f(ti) g(ti-nAT) n = 0, 1, 2, 3 N. 


i= 0 


(5) 


( 6 ) 


POWER SPECTRAL DENSITY COMPUTATIONS 


Correlation can also be used as a basis for computing power spectral density functions. 

According to the Weiner-Khinchin theorem, the cross -spectral density function is 
defined as 


(co) 


_ 1 _ 

27T 


00 


— 00 


0gf (t) (cos CO T - j sin CO r) d r» 


where $gf (cq) is the cross-spectral density function of time functions f(t) and g(t), 0 £ 

is the cross correlation function of the two time functions, and the radian frequency ^ 
CO is the independent variable. 


Similarly, the power spectral density function is defined by 

00 


'i'ff(w) = 



0ff (r) COS O) T d T . 


These two equations provide a convenient means for analyzing random data on the basis 
of the distribution of their frequencies, as opposed to time correlations. This type of 

analysis will prove particularly effective in revealing frequency response characteristics 
of systems subjected to random excitation. 

DESIGN CONCEPT 


The Model 257 and Model 258 Correlators are special-purpose computers which 
employ both analog and digital techniques to compute the auto- and crosscorrelation 
xunctions of electrical signals. Both models are designed to operate on a real- 
time basis with Technical Measurement Corporation's Computer of Average Transients; 

the Model 257 is used with 400-address CAT ^ instruments and the Model 258 with 
the 1024-address CAT ^ 1000. 

Unlike conventional correlation computers which calculate a single point of the cor- 
relation function for one complete set of data points, the Model 257 simultaneously 
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evaluates up to 256 correlation points while the input signal is present. Computed 
information is stored in digital form in the memory of the CAT. This information may 
be observed on the CAT*s built-in cathode ray tube or read out through a variety of 
analog and digital recorders. 

PRINCIPLE OF OPERATION 

A simplified block diagram of the CAT/Correlator system is shown in Figure 1. 

The computation technique employed by the Correlator is basically similar for both 
autocorrelation and cross correlation. One input is sampled periodically, converted 
into a digital binary number, and then stored in the memory of the Correlator. The 
time between samples At is made equal to the time delay increment At for which the 
correlation function is to be computed. The sampling rate may be selected by means 
of a front -panel switch to obtain the maximum number of correlation points consistent 
with an adequate sampling rate for the frequency components in the input signal. 
(Because of the Correlator's on-line operation, a compromise must be made between 
the number of correlation points computed and the delay increment. Normally, four 
samples or more per cycle of the highest frequency component is acceptable.) 

Each sample is converted into an equivalent digital value by means of a voltage- 
controlled oscillator which generates a pulse train whose frequency is proportional 
to the amplitude of the sampled waveform. Pulses from this oscillator are counted 
for a fixed period of time and stored in the Correlator memory with an additional bit 
which indicates the polarity of the sample. 

When the memory of the Correlator is full, it contains the last 32, 64, 128, or 256 
(as selected by a front panel control) sampled values of the first input function g(t). 
For example, when 32 samples are taken (see Figure 2), the time delay nAp is 
created by sampling g(t) at intervals of At seconds apart, so that the last sample 
stored in the Correlator memory has a delay of 0, the next to last sample has a delay 
of At, etc. for all incremental values of n up to 31. After each new data sample, 
the entire contents of the memory are read out, and each number is multiplied by the 
real-time value f(ti) of the second input. Because of the speed of the multiplication 
process, this real-time value f(ti) is essentially constant for each series of partial 
products. 

The digital values read out from the Correlator memory are converted into analog form 
by means of a current- summing ladder network and amplifier, then fed to one input of 
an analog multiplier. At the same time, another signal representing the real-time 
value of f(t) is fed to a second input of the multiplier. This analog multiplier operates 
on the Hall effect principle. The first input generates a magnetic field while the 
second generates a current. This current is passed through a semiconductor wafer 
which is placed in a plane perpendicular to the magnetic field, producing a resultant 
voltage which is proportional to the product of the two inputs. 



I CO^UTER _OF 


Figure 1. Simplified Block Diagram of TMC Correlation Computer System 

(input selector switch shown in position for crosscorrelation). 
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g (to- 31 At) 


At 



Figure 2. Correlator Memory Updating Process. 

(a) When the Correlator memory is filled at time to, it contains 

32 sampled values of g(t), spaced at equal intervals of At seconds 
apart. Within the next At seconds, the entire contents of the 
memory are read out and multiplied by the second input f(t). 

(b) After one readout cycle, the oldest sample g(to“31 At) is replaced 
by g(ti), and the readout and multiplication cycles repeated. 

(c) This same sequence is again repeated at time tz, with sample g(t2) 
replacing g(ti-3lAT) and a new set of partial products obtained. 


In crosscorrelation computations, each series of partial products constitutes a set of 
values for f(ti) g(ti-n AT) for a particular value of tj^ and all values of n. In auto- 
correlation computations, the process is similar except that two inputs are derived 
from the same source and the series of partial products represents a set of values for 
f(ti) f(ti-nAT) for constant ti. 

As each multiplication is performed, the partial product is read out to the memory of 
the CAT. Data is then stored in a series of successive CAT memory addresses, each 
of which corresponds to a specific value of n (see Table 1). For each sample, a new 
partial product is added to the data already accumulated in each memory address, so 
that the information contained in each address represents a cumulative total of 
f(ti) g(ti“nAT) for all values of tj^ and for one particular value of n. 





TABLE 1 



REAL TIME 

0 


CAT ADDRESS NUMBER 

1 2 

n 

^0 

f(to) g(to) 

f(to) 

g(to - at) 

f(to) g(to “ 2 At) 

f(to) g(to “ nAT) 


f(ti) g(ti) 

f(ti) 

1 

> 

f(tl) g(ti - 2 At) 

f(ti) g(ti - nAT) 

^2 

f(t2) g(t2) 

f(t2) 

g(t2 - at) 

f(t2) g(t2 - 2 At) 

f(t 2 ) g(t 2 - n At) 

• • • • 

• • • • 

f(tk) g(tk) 

f(tk) 

• 

1 

t> 

• • • • 

f(tk) g(t]^ - 2 At) 

• • • • 

f(t},) g(t]^ - nAT) 


k 

S f(ti) gCtj) 
i= 0 


k 

S f(tj^) g(ti - At) 
i=0 


k 

S f(ti) g(ti - 2 At) 
i“0 


k 

S f(t^) g(t . - n At) 
i=0 


When the last partial product for each value of tj^ is read into the CAT, the memory of 
the Correlator is automatically updated by replacing the oldest sample of g(t) with the 
real-time value of the function. This value is immediately read out, multiplied by 
itself, and the product stored in the CAT address corresponding to zero delay. As 
this sequence is repeated, a continuous precession occurs so that the Correlator memory 
always contains the 32, 64, 128 or 256 most recent samples of g(t). 

The memory updating process can be visualized as continually storing data in discrete 
steps on a closed loop. At each revolution of the loop, the oldest data point is re- 
placed by more current information. 
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A five-position switch is provided on the front panel of the Correlator to permit se- 
lection of a preset integration time T corresponding to 25, 50, 100, 200 or «> times 
the total time delay Tmax. ^^is preset integration time control permits direct com- 
parison of correlograms computed for the same integration time, provided that the 
CAT is operated at a constant analysis time. 

In addition to the preset integration time control, automatic computation of a normali- 
zation factor is also provided by the CAT/ Correlator system. This normalization 
factor, which is directly proportional to the integration time T, is stored in the CAT 
address immediately following the address containing the value of the correlation 
function for Tj^ax. ^^e normalization count is accumulated during the period of time 
when the Correlator memory is being updated, and corresponds to a zero volt input 
to the CAT. Therefore, in addition to providing a measure of integration time, it also 
serves as a zero-volt-square reference point for the correlation function. * The most 
significant digits of the normalization factor are indicated by a Sodeco counter mounted 
on the front panel of the Correlator. 

Also mounted on the Correlator's front panel are two controls for selecting the delay 
increment At. One switch selects both the number of correlation points and a cor- 
responding delay increment. The second allows the selected delay increment to be 
multiplied by a factor from 1 to 32. The two switches provide a total range of delay 
increments from 2.5 to 640 milliseconds for the Model 257 and from 1 to 256 
milliseconds for the Model 258. 

PROPERTIES AND EXAMPLES OF AUTOCORRELATION 

The autocorrelation function can be shown to have the following properties; 

1. As noted earlier, the autocorrelation function is an even function, i. e., 

0ff(r) = 0ff(-T). Consequently, the function can be completely defined by 
calculating 0 ££ (r) for positive values of r only. 

2. The value of the autocorrelation function for r = 0 is the mean square voltage 
of the time function. Substituting t = 0 in equation (2), 

-T 

3. The autocorrelation function has its maximum value for r = 0. 

4. If the time function contains periodic components, the autocorrelation function 
will contain components having the same periods. 


The correlation function has the dimension of volts squared. 
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5. If the time function contains only random components (noise) and no periodic com- 
ponents, the autocorrelation function will approach zero as t increases. The rate 
at which it approaches zero is a measure of the randomness of the time function and 
therefore of the bandwidth of the noise. 

6. If the time function is composed of two or more independent components, the resul- 
tant autocorrelation function will be the sum of the autocorrelation functions of 
each individual component. 

7. Each time function has only one possible autocorrelation function, but every auto- 
correlation function may be represented by an infinite number of time functions. 

This irreversible relationship arises from the loss of phase information when cal- 
culating the autocorrelation function. 

Examples of five typical time functions and their autocorrelograms are shown in 
Figures 3 through 7 in order to establish a basis for interpreting the results of auto- 
correlation. 


Figure 3(a) shows a simple sine wave whose time function is f(t) = A sin (ojt + a). Its 
autocorrelation function [Figure 3(b)] illustrates properties 2, 3, 4 and 7. The equation 
for this autocorrelation function is 

0ff(r) = — cos O) T. 

For T = 0, the value of the autocorrelation function is ^ , the mean square value of the 

2 

time function. Notice that the autocorrelation function has the same frequency as the 
time function and that the phase angle a is lost in the transformation. 


Figure 4(a) shows a square wave whose time function can be expressed as a Fourier 
series 

f(cot) = — (cos oot - l/3 cos 3 cot + 1/5 cos 5 cot - ... ). 


7T 


The autocorrelation function illustrated in Figure 4(b) is given by the equation 

2 

COT 



8V' 


T 


+ COS 3 cor + -^ cos 5 co t+ . . . . ). 


This example illustrates properties 2, 3, 4 and 6. It can easily be shown that 


( 0 ) 





■ ) = 


O 

where V is the mean square value of f(cot). Both the time function and the autocorrelation 
function contain an infinite number of components, the fundamental and harmonic fre- 
quencies being equal in both. 
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Figure 3. Time function (a) and Autocorrelation Function (b) of a 
Sine Wave Input. 


Figure 4. Time Function (a) and Autocorrelation Function (b) of a 
Square Wave Input. 


Figure 5. Time Function (a) and Autocorrelation Function (b) of a 
Wide Band Noise Input. 





Figure 6. Time Function (a) and Autocorrelation Function (b) of a 
Narrow Band Noise Input. 



Figure 7. Time Function (a) and Autocorrelation Function (b) of a 
Sine Wave Input Containing Wide Band Noise. 


n 


Figure 5(a) represents a time plot of wide band noise (i. e. , noise whose frequency 

spectrum is broad but finite). The autocorrelation function shown in Figure 5(b) has 
the form 


0ff(T) = Ke , 

where K is the mean square value of the noise and or is a measure of its band width. 
The exponential decay of the autocorrelation function illustrates property 5. 

Figure 6(a) is a time plot of narrow band noise (i. e. , noise vdiose frequency spectrum 

is narrow relative to its center frequency). The autocorrelation function in Figure 6(b) 
has the form 

0ff(T) = Ke cos p T , 

where K is the mean square value of the noise, o- is a measure of its band width and 

P is a measure of its center frequency. As in Figure 5(b), the autocorrelation function 
tends toward zero as T increases. 


Figures 7(a) and 7(b) show the time plot and autocorrelogram, respectively, of a sine 
wave with wide band noise superimposed. The correlogram, which is a composite of 
Figures 3(b) and 5(b), has the form 



(t) = Ke““^ + 



cos 00 T . 


This example illustrates the effectiveness of autocorrelation in detecting periodic 
components obsci^ed by noise. Since the amplitude of the autocorrelation function 
at T = 0 will be A + K and its envelope is asymptotic to 4 > autocorrelation provides 

a convenient means for determining the rms signal*"tO“noise ratio of the composite 
time function. 


PROPERTIES AND EXAMPLES OF CROSSCORRELATION 

The three basic properties of the crosscorrelation function are: 

1. The crosscorrelation function 0gf (t) is not necessarily an even function, and 
therefore in general 0 gf (r) / 0gf (~t). Consequently, a time shift of one input 

function in one direction with respect to the other does not produce the same 
result as an equal shift of the same function in the opposite direction. 

2* 0fg (t) = 0g£ (~t). a shift of one input function f(t) in one direction must yield the 

same result as an equal shift of the other input function g(t) in the opposite 
direction. 
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3. 0gf (r) does not necessarily have a maximum at r = 0. The maximum value of 
0 f (r) will occur for that value of time shift t for which the two input functions 
are most alike. 

To illustrate the application of cross correlation computation, four typical examples 
are given in Figures 8 through 11. 

Figure 8(a) shows an input signal disturbed by random noise. In order to determine 
whether the signal contains a periodic component of frequency oo^, a sine wave of 
that frequency [Figure 8(b)] is generated and crosscorrelated with the input signal. 


Let the time function of the unknown signal be 
f(t) = Si (t) + N(t), 

where Si (t) represents the periodic component (a square wave) and N(t) represents the 
noise component, and let the time function of the reference signal be 


g(t) = B sin(cOot +(3) = S2(t). 


The crosscorrelation function may then be written as 

T 


0gf(T) = 


Lim 


1 


00 2T 


-T 


[Si(t) + N(t) ] S2(t-T) dt 


^S2Si^'’’^ ^ ^S2N 


This yields a result which is the sum of two crosscorrelation terms, one of the unknown 
signal with the reference signal, and the other of the noise with the reference signal. 
Assuming that N(t) is statistically independent of S2(t), the term 0 S2N (7) will equal 
zero. The remaining term is a sinusoidal function [shown in Figure 8(c)] whose fre- 
quency is common to f(t) and (g)t, and whose phase angle is equal to the difference 
between the phase angles of the common component in the two time functions. 

For a given record length, this method of signal-in-noise detection will provide a 
greater improvement in signal-to-noise ratio than can be obtained through auto- 
correlation techniques. This advantage can be seen by comparing the number of noise 
terms appearing in the cross- and autocorrelation functions, the crosscorrelation 
function having only one while the autocorrelation function contains three. 


Another method for detecting a signal obscured by noise is illustrated in Figure 9. 
This method consists of cross correlating the obscured signal [Figure 9(a)] with a 
series of narrow pulses [Figure 9(b)] which has the same fundamental frequency as 
the obscured signal. It can be shown that the resultant cross correlation function, 
shown in Figure 9(c), has a waveshape identical to that of the hidden signal. 
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(c) 


Figure 8. (a) Time Function of a Square Wave Input Containing 

Random Noise, (b) Time Function of a Sine Wave Generated at 
Same Frequency as the Square Wave Input, and (c) Crosscorrelo- 
gram Resulting from Grosscorrelating Functions Shown in (a) and(b) . 
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Figure 9. (a) Time Function of a Triangular Wave Input Containing 

Random Noise, (b) Time Function of a Series of Narrow Pulses 
Having the Same Fundamental Frequency as the Triangular Wave, 

and (c) Crosscorrelogram Resulting from Crosscorrelating Functions 
Shown in (a) and (b). 
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The obvious advantage of this method over autocorrelation is that of preserving phase 
information. Consequently, the resulting crosscorrelogram is a proportional replica 
of the original time function. 

This method also offers two advantages over the technique illustrated in Figure 7. 

First, it will identify the complete signal waveform as opposed to a single frequency 
component; and second, for a given record length, it will produce an even greater 
improvement in signal-to-noise ratio. 

Illustrated in Figure 10(a) is a possible acoustics application. The problem is to de- 
termine the contribution made by noise source G to the overall noise level at point F. 

A microphone placed at point F will detect the overall noise level 

f(t) = A (t - a) + B(t - p) + C(t - y) + + G(t - 0) . 

A second microphone is so located as to detect only the sound produced by source G 

g(t) = G(t). 

Crosscorrelating f(t) and g(t). 

Assuming that the sound produced by each noise source is statistically independent of 
that produced by all other sources, the terms 0 qa* “^GB* ^GC* ^GD ^GE each 
equal zero. A plot of the resulting crosscorrelation function is shown in Figure 10(b). 
The peak value of the function occurs for t= 6, where 0 is transit time from point G 
to point F. 

If multiple sound paths exist, the correlogram will contain one peak for each path. 

The value of the abscissa at each peak will correspond to the transit time for the re- 
lated sound path, while the ordinate of each peak indicates its relative contribution. 

If the second microphone is moved to points A, B, C, D and E in sequence and a 
similar crosscorrelation computation performed for each point, the individual correlo- 
grams obtained will provide a basis for determining the contribution of each source to 
the overall sound level at point F. 

The use of crosscorrelation in measuring system impulse-response characteristics is 
illustrated in Figure 11. Function f^(t) represents an uncontrollable and unmeasureable 
disturbance acting upon the system; fj^(t) and fo(t) ^re the system input and output 
functions, respectively. The problem is to determine h(T), the unit impulse-response 
of the system. 
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Figure 10. (a) Location of Multiple Noise Sources with Respect 

to Point F and (b) Correlogram Resulting from Cross correlation 
of Output of a Microphone Placed at Point G with Output of a 
Second Microphone at Point F. 
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Figure 11. 







A direct measurement of h(r) cannot be made by applying a unit impulse to the input 
of the system because the output would contain a contribution due to f^jW. the system 
disturbance. However, it can be shown that the crosscorrelation function of the system 
input fi(t) with its output fo(t) in terms of the impulse-response function h(T) is 


0io(T) = 


00 


—CO 


h(X) 0ii(T *" X) d X + C, 


where C is a constant. 

This equation is the convolution of the system impulse-response function with the input 
autocorrelation function. The constant C can be made equal to zero if the time average 
of either fj(t) or f(^(t) is zero. Therefore, if one were to supply an input consisting 
entirely of wide band random noise (whose autocorrelation function is itself a unit im- 
pulse), the resultant cross correlation of input with output yields the system impulse- 
response h(T). 

Although necessarily incomplete, these examples serve to indicate how powerful a tool 
correlation can be for analyzing otherwise indeterminant signals and their effects. 
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